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SUMMARY 


be  k  given  populations. 


Diet 


R 


Let  71 

Assunie  that  we  wish  to  find  a  population  bet  ITT  ftrrm  n* 
given  control,  if  there  is  any.  From  all  populations  we  may  draw  inde¬ 
pendent  samples  with  distributions  which  are  {at  least  partly)  determin¬ 
ed  by  real  parameters  o.| ,. . .  say.  A  population  n  .  is  viewed  to  be 


better  than  the  control  if  i  =  l,...,k,  where  (  IK  is  a  fixed 


given  constant.  The  goal  is  to  guarantee  at  least  a  p7obal)ility  P*  of 
making  a  correct  decision  if  (i-  <  i=l,...,k,  and  to  maximi/e  the  prob 


ability  of  finding  a  population  better  than  otherwise. 


Two-stage  procedures  of  the  following  type  will  be  studied;  At 
Stage  1,  based  on  samples  Xp...,X|^,  all  populations  are  strec'ned  out 


which  appear  to  be  no  better  than  If  none  (exactly  one)  is  left  the 


procedure  stops  and  decides  that  none  (this  one)  is  bettc.o-  ftian 


I  f 


more  than  one,  with  i  ts, survives  then  one  proceeds  to  Stage  P.  Here* 


additional  samples  Y.,  its,  are  dts 


drawn  and  final  decision  is  made  liastnl 


on 


or  ()■  .  ,Y.).  its. 


- 1  - 1 

A  natural  class  of  two-stage  procedures  is  propo'w'd  wltiih  La'i  oe 


completely  described  and  studied  in  terms  of  Neyman-l’earson  ti'sfing  the¬ 
ory,  where  the  unsyninetry  of  tests,  however,  can  be  overcome  to  ii  consid¬ 
erable  extent.  As  a  typical  result  it  is  shown  that  optimality  ot  tests 
carries  over  to  optimality  of  two-stage  procedures,  linally,  undta-  nnr- 
niality,  co'spa r i sons  are  made  in  case  of  k'  ?  with  certain  Itavesi.m  pro- 
ceilures . 


/ 


r 


1.  Introduction 

If  k  populations  are  Qiven  and  we  wish  to  decide  on  the 

basis  of  a  properly  chosen  sampling  scheme  which  one  o1  these  popula¬ 
tions  is  the  best  one  (e.g.  has  the  largest  mean),  various  different  ap¬ 
proaches  and  methods  have  been  studied  up  to  now.  A  complete  overview 
is  provided  by  Gupta  and  Panchapakesan  (1979).  Among  those,  two-sta<ie 
procedures  with  screening  in  the  first  stage  seem  to  be  pjiff^  appropri¬ 
ate,  since  they  are  more  economical  as  one-stage  procedures  but  still 
technically  not  as  complicated  as  sequential  ones.  Neverthel e; s ,  op'i- 
mality  results  here  are  missing  up  to  now  and  obviously  are  hard  to  find. 
Even  the  implementation  of  a  simple  procedure  (as  that  one  which  uses 
Gupta's  (1965)  maximum  means  procedure  in  the  first  stage  atul  the  nat¬ 
ural  final  decision  in  the  second  stage)  in  an  indifference  /one  apiiroacn 
under  the  assumption  of  normality  with  a  common  known  vai icinre  causes 
considerable  difficulties.  For  details  and  references  see  Tacilsanr-  and 
Bechhofer  (1979),  Gupta  and  Mieseke  (1979;  and  MiescKO  and  Sehr  (1980). 

The  situation  becomes  somewhat  fairer  i  *'  we  wish  to  find  a  populri- 
tion  better  than  a  control  whether  it  is  known  or  unknown.  This  be¬ 
cause  pairwise  comparisons  are  to  bo  made  now  octween  .  and  instead 

of  II.  and  iij,  i?^,i,  i,  j€  1 . k  I  c-t  us  admit  ht'rc'  addi  f  lonal  1  y  ihi' 

choice  of  a  final  decision  "none  of  fbo  ,  i.iui  ions  i'  fetter  tn.in  tue 
control".  Moreover,  let  us  adopt  ttie  toll'nvKiu  fas't  ■  lu  ■  reim  is.  ■  u: 
goa  1 : 

f’*-Condi  tion :  Let  P*  (  (i.f,l)  be  a  preiietennined  i.onstant.  .  pt  eie  l  .r-; 

is  said  to  meet  the  F'*-(.otidi  t  ion  if  its  preauaPi  1 1  ty  ul  mul'ing  'die 

final  decision;  "none  of  'he  popn  I  u '  i  ons  is  bet  !.er  '  n.e  ;tie  .,(i'.'rr,r 


is  lit  least  P*  wfienever  ♦  iii  s  decisioii  is  (.uri  lu  i  . 


G^al.:  Among  all  procedures  (ir  a  given  class)  which  meet  the  P*-condition 

find  that  procedure  which  maximizes  the  probability  of  decidimj  final¬ 
ly  in  favor  of  a  population  better  than  the  control  if  there  is  any. 
The  purpose  of  this  paper  is  to  show  that  a  natural  class  of  two-stage 
procedures,  being  widely  used  in  practice,  can  be  described  and  studied 
within  the  framework  of  Neyman-Pearson  testing  theory,  where  the  unsymiii'-- 
try  of  tests  can  be  overcome  to  a  considerable  extent.  Emphasis  hereby 
is  laid  on  the  basic  structure  and  on  comparisons  of  such  procedur-ns  rather 
than  on  establishing  specified  ones. 

In  Section  2  we  introduce  a  natural  class  jS  '  of  two-stage  procedutes 
and  derive  a  formula  for  their  probabilities  of  correct  decisions.  As  a 
typical  consequence  it  will  be  demonstrated  in  Sectioti  3  that  two-stage 
procedures  based  on  good  unbiased  one-sample  tests  for  H- ;  "population 
7:.  is  better  than  versus  K.j :  "population  1.1  is  inferior  with  respect 
to  -r^",  which  are  simultaneously  good  tests  for  the  dual  problem  (wftere 
H.j  and  are  interchanged),  perform  well.  Three  open  (juestions  somlude 
this  section.  Finally,  in  Section  4  we  study  the  nonnal  case  and  mak(f 
some  comparisons  with  certain  Bayesian  procedures  in  the  case  of  k  2 
populations. 


2.  Basic  results 


Suppose  that  for  every  ’i.,  i'l,..  .k,  we  have  a  family 
ff_.  g  '  g  c  ,  of  densities  with  respect  to  the  lebesc|ue  me.isuro 

or  any  counting  measure  on  which  have  a  conino:'.  cpport  >  D-:  and  m>iy 

be  known  or  onlv  partly  known.  Tfie  assumption  cotKorning  the  supports 
is  made  for  convenience  to  make  ideas  clearer  and  can  l)e  weaktnu'd  in  ler- 

■  ,  say. 


tain  circumstances.  Let  the  fixed  known  control  be  denoted  by 


and  all  populationb  be  called  better  than  the  control  if  -j  ■ 

inferior  to  it  if  ^  Let  -  (X.^ . .  ,X.  )  and  Y-  ^  (Y.,  .  ,Y.  ) , 

i  i 

i  =  l,...,k,  be  samples  from  7i^.  available  at  Staye  1  and  Stage  2,  respective¬ 
ly,  where  X-j  ,Y^ .  ,X|^,Y|^  are  mutually  independent,  and  let  X (X^,...,X|^) 
and  Y  =  (Yp  •  •  •  -Yi^)  ■ 

Before  we  are  going  to  define  a  natural  class  of  two-stage  procedor^' , 
in  a  concise  way,  let  us  briefly  describe  how  these  procedures  typically 
are  applied  in  practice.  For  every  testing  problem  K. :  ■.  ■  ^  versus 

^i  ■  "i  ^  '*0  experimenter  chooses  a  test  based  oti  X-  and  for  tu  ver¬ 
sus  another  one  based  on  Y.  or  (X^,Y^),  i  1,...,k,  takes  two  levels 
>t^,»2f(0,l)  (which  usually  are  small)  and  proceeds  as  follows: 

At  Stage  1  he  discards  all  populations  which  are  not  significant  at 
level  under  the  first  ser  of  tests.  If  none  (exactly  otie)  is  left,  he 
decides  that  none  (this  one)  is  better  than  the  control.  Only  if  mot'e 
than  one  population  survives,  he  proceeds  to  Stage  ?. 

At  Stage  2  the  experimenter  draws  adoitional  samples  Yj  1  roi’i  those 
II. 's  which  were  selected  at  Stage  1  and  exchanges  hynotheses  arnt  alfen,,!- 
lives  with  respect  to  ths'sc  poiiulations.  If  all  these  [.'opulations  now 
turn  out  to  be  significant  at  u-v.-!  under  the  second  sot  nt  tests 
(which  is  rather  unlikely  to  happe:. :  he  i.U\  ides  that  none  ot  the  peiiul.i- 
tions  is  better  than  the  control,  'dtherwtse.  hr  n.akes  j  tiril  ot  i 
in  favor  of  tliat  population  amonij  the  selected  oiu's  wliic.’i  has  t  lu;  l.iici'  s  ; 
p-valuc  under  the  associated  seiumt!  Ic'. 

If  these  tests  are  upper  levrd  ( rt'sp.cct  i  vel  y  lower  level  i  ’e,!'  , 
which  for  simplicity  are  note  randui ,  i  ,'ed  tor  a  'lonii'iit  t'l  1  i idear.  ha  ; 
on  real  valued  statistic',  li.  and  ,  i  l,...,t,  tlien  !  lie  ediit-e 


‘1 


described  above  can  be  equivalently  described  as  follows:  At  Staqo  I  all 
Ti^'s  are  selected  with  ''  c^  (where  c-  is  the  dj-fractile  of  U-  under 
Of  -  t'^),  and  final  decision  is  made  in  terms  of  the  largest  ainoiuj  the 
selected  n.'s,  provided  V.  >  d.  (where  d.  is  the  jp-quantile  of  V  under 
Oj  =  0^).  The  truncated  version  of  such  procedures  (i.e.  which  perform 
Stage  1  only)  have  been  studied  by  several  authors.  See,  for  oxainple, 

Gupta  and  Sobel  (1958)  and  Lehmann  (1961).  Also  some  work  has  Ireen  done 
in  sequential  setups.  For  references  see  Gupta  and  Panchapakesan  (l')/d). 
Chapter  20.  But,  apparently,  no  results  concerning  two-stage  protediirt". 
of  the  type  described  above  have  appeared  in  literature  until  now.  Kit. 
gives  us  the  motivation  for  the  following  considerations. 

To  begin  with,  let  us  state  without  a  formal  proof  that  by  sirdlar 
arguments  as  are  used  in  Miescke  (1979a)  it  can  be  shown  that  every  pro¬ 
cedure  of  the  type  described  just  now  -  where  U.,  c.  and  \l-,  d.  iiiore  (jen- 
erally  may  take  values  in  measurable  spaces  and  X-  ,  and  where  and 
V.j  are  stochastically  non-decreasing  in  with  respect  1o  measurat'le  total 
orderings  in  and  ^  ,  i=l,...,k  -  is  a  member  of  the  class  to  be  ile- 
fined  below. 

To  avoid  confusions  and  to  arrive  at  a  consistent  representati on  ot 
this  class  let  us  from  now  on  use  only  tests  for  H.  versus  K. ,  i 
which  take  value  1  as  soon  as  one  observation  falls  outside  support  Q. 

(This  modifies  procedures  only  on  null-sets.)  finally,  several  detinitions 
given  in  Miescke  (1979a)  will  be  relevant  in  the  se()uel  but  for  hrevitv 
are  not  repeated  here.  Especially,  tests  may  he  randomi/(*d  ones  takii\g 
values  in  [0,1].  This  typically  occurs  in  discrete  cases  or  in  continiious 
cases  when  nonparametric  (rank)  tests  are  under  concern.  Thus  s  i  (jni  I  i  (  am  e 


') 


statenietits  as  well  as  p-values  are  utiderstood  to  be  based  oti  .uidiLiotidl 

randomization  schemes  as  are  used  in  Miescke  (1979a).  To  be  more  specific 

let  A  =  (A.|  , . . .  ,A|^)  be  that  one  For  the  first  stage  and  B  = 

that  one  for  the  second  stage.  Note  that  X,  Y,  A  and  B  are  assumed  to  be 

independent. 

The  class  a  of  t_wo-s_U^  procedures : 

For  i=l ,. . . ,k  let 

(1)  c,  =  { S  .  1  be  a  right-cont  i nuous  and  monotone  (in  ,) 

1  1 ,  u  .tc  LU? '  J 

unbiased  test  for  IK  versus  K.  based  on  X.,  which  is  standardiz¬ 
ed  at  Oq.  Assume  that  within  Q  0  and  ^  1.  Let 


(2)  Analogously,  let  v-  =  ii;.j  }  ^  j-^  be  such  a  test  for  i|.  ver¬ 
sus  K.  based  on  (X-,Y.).  Let  .  -  (. -j . 
for  0  •:  ,1^  •,  1  and  0  -  •  1  let  ( s ,  1  -  ■  i , .  ,  )  denote  tne  following  two- 

stage  procedure: 

Stage  I:  Select  ii.j  if  p.  (X^A.),  the  p-value  of  X.  under  is  larger 
than  I-‘i'  i-I,...,k.  If  none  (exactly  one)  of  the  ponuhiticns  is 
selected,  stop  and  de(:!de  "none  (this  one)  is  better  than  ■  .  (gfu-* 

wise  proceed  to  Stage  2. 

Stage  :  Amoncj  the  selected  populations  ci.-v  me  finally  in  favor  ■!  (is’f 
11  j  which  has  the  largest  p-va1ue  p  (X^fj-l'-)  on  lor  luo'.  1 1...  :  i' 
is  no  smaller  than  Ot.lierwise  decide  that  ■dsine  Ino  ter  i  nan 

let.  A  1)0  tne  set  of  all  sucn  two-sta<]e  proceduros. 

The  following  result  will  sinve  <is  our  basu;  tool  t('  deterniino 
(  1 1  tupl  f's  for  meeting  the  l’*-condi  t  ion  as  well  as  to  lonipai'e  ini'  in'i 

fomr.iirue  of  fnmpeting  i)i()ceil;jres  ■^.a  1 1 i  y  i  n  ;  tne  1’’“ ond  i  t  i  oo 


Jhejy'jfn. J_.  Let  (<,  ,1-u^  ^  ^  notational  convenience  let 

t,  ^  ^  (X^.)  and  E^.(-i)  =  E^^  »■(  j ) ;  i^ot  cignificunt  under 

^  ^  ^  k 

S-  1  },  i  =  l,...,k.  Then  for  every  non-empty  D tl,...,kl  and  ■( 

•  >  •  "U-j  -  - . 

(2.1)  P^^{final  decision  of  (s,l  -  >p;',(2)  ''alls  into  D; 


=  /  n  [L>(l-E  )l  (.)]d(  II  [f  .  +  (l-i;,)l  .(.c)J 

_•  >  r»  .J  .J  I  -  r-s  1  1  I 


)  AX'-  1  '  AAi-'-, 

■  >2  j  f  D  J  ■'  J  i  c  n  ' 


where  integration  is_v^ij^h  re_sp)ect  to  i.  Moreover, 

(2.2)  P,  jfinal  decision  of  (v  J-'<p.',i2'  } 


n[E,+(i-E,)r.(«,)]  . 


d  J  d 


Proof;  It  is  shown  in  Miescke  (1979a)(cf.  (2.3)  there)  that  the  distrihu- 
tion  function  of  each  p-value  appearing  in  (s  ,l-  t^,,,  i2)  equals  to  r.he 
power  function  of  the  corresponding  test,  which  hereby  is  thought  of  beinn 
a  function  of  i€[0,l]  where  parameter  >■  €  d  on  the  other  hand  is  held 
fixed. 

Let  D  c.  { 1  , .  . .  ,k ) ,  D  ^  0  ,  -j  C  t;  ,  0  ■■  •  1  and  0  ■  ip  1  be  1 1  x- 

ed.  Then 

P(,  {final  decision  falls  into  O' 

=  V  P  {final  decision  is  in  favor  of  n  1 
rf'D  - 

-  )  P  tthe  n . '  s  with  i  Cs  are  selected  and  final 

rCD  s:r€s  - 

decision  is  made  in  favor-  d!  ; 


I  I  .11  l-(■‘)d^;.(0  II  (I-L.)  11  r 


r  f  [1  s:r  e  s  ..  its 
i  7  r 


I  /  II  ri  f:,!d((i-L  ),  ( 

r  (  U  a„  (  s  ;r  (j  s  i  C  5  j  ^ 

)  /  >■ 


Now,  the  integrand  equals  to  II  [E-Ml-t.,  )F  ,(  ,j  j  and  (  1-l 

1  !  ’  '  '  ' 
i  /  r- 

can  be  replaced  by  E^+( 1 )l ^(  ,) ,  Thus  P  -  final  decision  fn  ll-  int"  ' 


equals 


1  k 


V  /  II[E.  +  (1-E  )r  (0]d[L  ^(1-L-  )l  (01 

-  /•  n  ,  - 1  '  I  '  '  r  r 


r  (  D  t.,,  i  =  I 
i^r 


/  II  [E  f(l-L,)r  (OJ  '  II  -li  M  -'idii  - 

j  ^  I)  J  '  r  (  !  I  1  (  b  '  '  ’  ' 

]  /  r 


1 

•  f  II  [E  +(1-E,)r  (.)Jd(  n  CE,  +  (l-E  JIp\)]  !  . 

*2  J  <i  E  ’  '  i  t  D  ’  '  ' 

This  completes  the  proof  of  (2.1).  Since  (2.2)  cai,  be  verified  by  - 
irig  similar  arguments  its  proo*  is  omitted  for  brevity. 

Remark:  Note  ttiat  for  i  =  i,...,k  we  iiavs"  also  tne  lol  lowifU)  representa :  i  s-n 

of  E.r(l-L.)r.(  ,.),  .(  [b,l  ]; 


I  1  1 

E  ,  (  -  P  (  ,A^  )  •  1-  ^  ; 


;  ■  I  -  '  .  an.-*  p  {  ,  V  .  , ; 


(.orollary  i.  [very  two-strige  procedijrt'  .  .  i 'aMsfn 
r'*-cond  i  tion  if 


(I~m)'  '■* 


(2.4) 


r 


Pron*-'-  iov/('t'  bound  <’oi'  i'>  II  i  ^  whii^n  suliMip', 


k  k 

II n 

j  -- 1  ^  j  - 1 


n  ,  (X.)  •  n  i 

rl  j  '1  ,1  o 


!'■  0 ' 


Inis  follows  from  the  '.iiibi  (ist'diies  ,  nf  tile  tj 


Unfo"tunatel  V ,  tlie  dependencies  between 


.  ,  (  A  .  ,1  U  lul  I  ‘  ,  I  ■  , 

1  ,  1  -  l  ,  ■  1  ■  I  ,  :  I  I 


i^l,...,k,  make  it  liand  to  find  good  pt-ocedui'es  it 


I  net'e*  oi'e  iim  i 


our  results  in  tiie  sequel  will  be  given  onlv  witii  respect  tn  j  .,)v,  ■..heti 
i',  '  c  •t-  consists  ot  all  procedures  from  x,  wiiere  the  test.s  in  tiif  ...siuul 


stage  depend  only  on  *  tie  Yj's  and  'lot  on  tiuj  s,  i  1,. 


1  ill'  I  lit  >1 


ed  reader  is  invited  to  try  to  prove  one  of  tin*  ^.onjectut  stated  ,i'  M; 
end  of  this  section. 


Corollary  I'.  two-stage  I'rocedure  (  .  ,t  ,)  '  a  '  satr  ties  •  In 

P*-condi*ion  it  .and  only  if 


Proof :  let 


1 -  k  ■  '  0  ■ 


O I  i  ,  I  -  < 


1 


,  t., )  (  j. '  { .  u )  rediii  es 


'-.i 


•  ';  )  i  I  ■■  t  i  ! 

',i ' 


which,  Li\  the  unb  i  asedno-.s  of  t  tn  ts'St.,  and  •tie  tai  t  that  ,it(i-a 
t)t(l-h;a  '  .  InC'ea^  i'i'l  in  i,  it  f  iO.lj,  .iMiiiKn-  i's  lowest  value  a' 


t  0 


,  wtiere  tiie  oowt'r  tuni  Mote,  aee  iniii.i  1  to  tin-  'rsi  1  .  ot 


the  tost'-. . 


Pemark:  It  i  rt  ii  [irocedure  (  .  1 |  i  x.  every  pair  ot  't.,!'  ^  , 

have  non-nt'ia  f  i  ye  (  orrelat  iote,  lor  •'.  ■  ',11 . 1  I'whuti,  e(  i  out  .i- 

I  o 

is  iiivt'n  t  t  hi  pr'n  a'llur"  |iei"rer.  le  y.  ‘  i,  t  ttc  ;  tie  I'ltn-'.ir:  .e  ...  '  sti 


J 


k  I- 

falls  between  (l-i^)  and  (1-i^t.p,^)'  . 

Let  us  from  now  on  adopt  the  followinq  convention: 

Convention:  All  pnoci'dures  from  jS  '  are  .issumed  to  iiave  .in  .j 

ing  (l-i^)  =  P*  and  a  small  i2- 

L 

In  view  of  (2.5)  (l-a^)  =  P*  and  -  0  clearly  is  i.'n-  m.  , t  ..ncjicc 

minimize  the  expected  overall  samplinq  amount  (and  to  make  to  an 

act  condition  with  respect  to  i  ).  But  on  ttie  other  nand  at:  expe:'.!  ;onto- 
mitjht  feel  restricted  at  not  being  permitted  to  decide  also  at  bta  ,o  2 
against  all  populations.  Thus  let  us  admit  at  least  a  small  Ttiis  is 

slightly  conservative  with  repsect  to  (2.5).  But  it  changes  the  orobabil- 
ities  of  any  events  at  most  by  a  diffe'^ence  of  (max  ■,  This  fol¬ 

lows  from  the  fact  that  ^cts  only  on  pi'OPabi  1  i  t  i es  of  events  wnere  at 
least  two  populations  pass  Stage  1  and  eventually  are  reiec.te.i  ,;t  Sta:;e  ,  . 
To  (jive  a  numerical  example,  take  .j  '■  ...  -  10  .  Th-.-'.  ih  k -•  5(l;j!  we 

have  a  P*  above  0.95  (0.90)  and  cnanges  all  probabi  i  i i c-s  it  most  0. 

-4 

the  amount  of  10  . 


3.  Consequences  and  extensions 

The  following  two  re:.u!'s  will  be  used  repeatedly  in  l  he  '.('(ijcl.  Tlie 
jiroofs  are  straightforward  usin';  i n' t graf i ons  by  jiarts  and  art  ineretnrt 
omitted  for  brevity. 


Lemma  1.  Let  ,  G.  ;  [0,1]  ^  [0,1J  be  ri gh t-con t i nuons ,  non-Otci'e.; 

with  Gj(l)  ■  G^(l)  -  1  andCi^fi)  ■■  (  )Gj(.)  for  i  l,...,,-(i  iil,..,,k), 
r(  il,...,k|.  Then  for  0  •  .-,1 


)  r  k 

/  11  G.(<)d(n  G  (,)) 

>2  i^l  J  rO  ■'  ' 


II  G  m  .)d(  II  I. .  (  . ;  ) 

i-1  '  ,im-l  ' 


(  i.l) 


r 


As  a  special  case  of  Lemma  1  vie  fjel 

Corollary  1.  L ('t  . .  .  .  ,Ci|,  as  before  arid  b ^  (  t)  ■  <1^(0,  >  (  tb,  I  1 ,  f  oi  ,i 

{^air  1,  j  L  '! . k:  wif^  i  /  J.  Tneri  for  0  ■  ty  ■  1 

1  k  Ik 

(3.  Cl  1"  II  -  (  :)d''‘  .  (  i)  ■'  f  II  b  (  i  )d(j  .  (  I  )  . 

.1  ■  ''  r,  .^1 

'  ./i 

"or  the  seoiiol  lot  !'  ^C.D.  i  denole  the  probability  ot  a  currer  (  ilci  i 
sion  at  ■  t  '  ,  i.e.  thal  tht>  final  oeci'.ion  falls  into  Rpj)  '  '  j 
i-l,...,k-  if  R(1  IS  Moii'empty  or  that  the  fin.il  decisiori  is  "no  popula¬ 
tion  is  iielfer  than  if  R'_)  is  empty. 

CaralJ^ry  i.  ’  et  !  f  A',  fi  •  1  and  •  ‘p  ■  1.  M  for 

everj  i  ^  and  ..  are  ilMI'  unbiased  tests  for  !i^  versus  r.  based 

on  .X^  and  Y.  and  if  ■>  ciu  Uaneous  ly  l-s-  and  1-.;  are  (IMP  unbiased  ti-iststm 
the  dual  Lestincj  problem  (wi;eee  tne  hypothesis  and  the  dlternativc  are  intm- 
changeyi )  ^  ■  nen  at  ever/  ■  <  (s  has  the  largest  b  and 

the  smallest  e.xpected  ..ompliimj  amount  amunn  all  (_  ,  1  -  >  ^  ;  1  t  j  '  ■ 

As  i  1  well  tn.swn,  tnes(-  cnnOi  <  lOre-  aei'  ir.i,allv  fulfilled  in  one-piira- 
meter  MLk  and  mu  1 1  i  parameter  expoe.iM'tia  1  family  situations,  'l^tie  prriof  ot 
Corollar'v  ■'  a  vm.‘ 1 1  .is  ^hal  nf  tne  next  result  follow',  f  r'om  (I’.l)  and 
Lemma  1 . 


Corollary  4.  Let  ( ■,  ,  1-.,,.,.^'  <  Jt If  the  [rower  funetinnsot  all  tests 

are  non-dei. rea  ,  1  luj  (ixit;  itu.reasin.j)  in  ,ample-si/es  tor  .  ^  ^ 

k 

Pp.C.O.i  IS  norideerea  ,  i  nq  i'l  .aniple  si^'es  at  every/  t 


The  next  r'esult.  i  an  tie  slated  with  respect  to  a.  . 


Corollary  5.  Let  {'<_  ,  1  -  ,y,  i^)  f  A  where  .  cuosisf.  of  lodsi  r.tetit  fc' 

Then  P  i  C .  D.  t  converges  to  1  if  n .  >■  •  and  ^  ,  i  1  , .  .  .  ,  k . 


Proof:  Let  •*  c  ’  with  i=^l,...,k.  Then 

P,|ir.l).  i  ■  P|,lonly  M^.'s  with  i  (  i't(g)  are  selected  at  Stage  1: 


II  f„  i  1  n  [1-L.,  ■ 

J  4R('')  j  J’'*  1  -J  if  P(  )  i 


■  ,  (■■)J 


which  tends  to  1  for  large  n^,...,tY  by  the  consistency  of  tic*  Ic  t  > . 

Under  the  assumption  of  monotone  (non-decreasinci)  1  i kel  i s 
(MLR)  a  stronger  result  can  be  obtained. 

Theorem  2.  Assume  that  in  every  population  .  the  family  of  donsines  iiu- 
MLR,  i-l,...,k.  Let  (s  ,  1  -  )  <"  i-  (or  jL')  consist  of  the  UMP  tests 

for  the  corresponding  testing  problems.  Then  for  increasing  ai'iple  sizes 
n.,  III.,  i-l,...,k,  P  (final  decision  in  favor  of  that  with  the  lai'cjesl 
(  tends  to  1  for  all  i  f  ;  with  R(')  /  0  and  P  (final  decision  i'- 

i. 

"no  population  is  better  than  ■  tends  to  1  for  all  ■  f  with 
"l . "k  ■  0  • 

Proof:  Let  n  ■  i-  0  ■  1  iind  i  ■  I. 

k  0  1  1  -  I  1  / 

P  ((s  ,l-t^,y,<^)  finally  decides  i..  •avu--  . 

■  '-‘rP  ,  ■  z  . 

k  k  I 

fJow,  P  ■  l"'iiP  ( ^L.  ’ i  t.(‘n  P'  t,ii  i  tilt'  ti  ,11'-: 

K  I  -  K  -  K  I  k 

iiij^  by  Idle  ((insistency  of  Mie  tests. 

Moreover,  the  pnx.ediHV'  which  oecidi's  in  ‘‘.ivor  of  a  i  ^  j  on  ,c(, oil¬ 

ing  to  ttie  largest  p-valu('  with  ri-s(ici,l  (o  ,  i  n,  i  <  ..lewi'l,  i  -  n, ; /.•  1  la  '  ;  ,  , 
as  beuKi  b.ised  on  s.iv,  where  o  "ssent  i .  i  1  ,  'Si'  .ck  i  |i  ,t 


now  standard!  Z'.’d  a!  (in, trad  it  ■■  'i ,  i  1 . k.  But  thc*n  since  <ill 

I  o ' 

populations  ■;  p  . .  .  .  ■  ^  ^  a 'o  shilted  int-o  "alternatives", 

1  k- 1 

P,{p  '  p,  ,i/ki  '  P  p  •  |i  ,i/k:  -  /  11  t,,  (X.,Y.)di  , 

-  ’-'k  ‘1  -  -1  •■=  Oil  j  1 

(cf.  Miescke  (r}/9.i)  )  wi;!rn  u'nd'-  to  1  tor  laroe  nip  .  .  .  ,i;ip  Wtien  iinre 

than  one  ■  is  lai'oe-.t  a  sii:iil,ai'  M-sult  c.;"  be  derived.  Ttie  ii  "Oof  lor  a.' 

1  ' 

using  UMP  tests  i,,...,  ^  based  cr  is  exactly  the  same.  I  be 

second  assertion  of  ttu^  tHeor('ii  is  already  proved  by  Corrollary  b. 

Remark;  If  tiv.i  a-.yinptot  i  c  relative  etliciency  (ARP)  in  t.iie  sense  ot  Pit . 

is  defined  in  ten'.,  of  tiu  prooat.iiiVy  of  st'lecting  the  i-'s  witii  i  i 
at  Stage  I,  tb'.”,  it  APli  .  ■.  ,  ^  ;  foes  not  depend  on  i  t  il,...,k,'  fas  is 

typical  ly  the  case  wi.rn  s  j . .  are  of  the  same  type  anti  ,  j  ,  p 

are  of  tiie  same  lype'  wr'  hove  '''"'dp-p)  Ai';L(('.  ,  1  -  «pV  , ).('l  - '  -  >  I'l  - ‘p 

for  all  b  .  ■  I  •  I,  U  ...  1  ..nd  Itie  proot  is  similar  to  th.it  in 

Miescke  (1979d).  t’f  i  oiirsi  ,  it  ■.■.oi.td  be  soi  (>  satisfactory  to  tiave  an  API - 
concept  includiiui  both  da,  .  t'.t  ’Ins  s.'ei"  .  (.o  tie  a  liitiicult  proliletn. 

In  fart,  Pitma.'i's  aim  oai/i  toe.  tii,o  |ia'  nero  t.o  clear  comlusions. 

Corollary  b.  i  r  t  i .  it  tne  nower  f  unit  ions  ot  p  .ind 

Vj  are  non-  i  nc  rea s  I 'r;  I n  ;  •  .  .  i  '  , .  .  .  i  ,  t  net.  t  .ir  i  .  .  <  1  ,  ,  .  .  , l.  w  1 1  ti 

r  '  's 

1  1  na !  dei.  si'-n  ■  is  'avri  o'  ■ 

r 

I  '  I  r,,l  '  .ti-i  ;  I ,  a;  i  .  ni  I  ,1  vor  II  t 

Proof'.  ftir.  follows  i  >  om  .e’  ,  'o'lill.iiy 


f  i  n^l  HeiudrK.s ; 


(1)  The  results  so  far  derived  hold  analogously  in  cases  ^here  the 
control  values  may  depend  on  if  ll,...,ki. 

(2)  The  case  of  unknown  controls  can  be  treated  analogously  providea 
that  control  samples  are  drawn  independently  for  each  single  test. 

(3)  Under  the  assumption  of  MLk  let  (s  ,1-,^,- ,  t^)  (  js  consist  of  tiH' 
(IMP  tests  for  the  corresponding  testing  problems.  1  hen 

(3.4)  infiP  {C.D.  )  ju  f  ij  ^  .  R(g)  -  0  ,  -  infiP  tC.D.  ^  ,  /  0 


p  (  I  ',  . 

^  O’  o’- • • ’  o' 

This  follows  from  Theorem  1  in  a  recently  published  paiier  by  Si:;ions  J9f;o) 
(2.1)  and  Lemma  1 . 

(4)  Let  us  conclude  this  section  by  statirui  the  following  three  ii;i- 
portant  questions  that  have  not  been  settled  now:  Assume  that  in  all  [jopu 
lations  MLR  is  given  and  that  S  .  '*''c  UMP  test,  based  on  a., 

(Xj,Y.),  i-l,...,k. 

I)  Is  ( b  1  1- 11  ,vi  ip)  performing  better  than  (>.  i ^ 

(I)  [t  this  is  tfu.i,  how  well  performs  1  ,  1  •  ,)  in  .  . 

Ill)  The  one-stage  procedures  (  J-.,)  and  wniih  seW'':  .u,iir, 

inc)  to  the  largest  p-valiies  of  the  cor-resirrid  i  ng  te.ts.  providiil  tg.it  t  no . 
ate  l.irijer  than  I'lji  are  tiu'  natu'Ml  comiu.'t  1 1  tn  .  to  ,  ,! 

(  I  ,1  1, ,.,()).  Do  ftiev  need  larger  samelini  a''H)ui;l  s  t  ha  ■  ‘in'  t 

I  * 

|)roi  ciluri’s  t.jke  in  the  irMt'  to  (Mve  tin  sanii'  C  .9. 


4.  Ihe  noriiial  Last'.  i!,iye.i(in  twu  stage  jaijcediii  <  ■,  tor  i 

Assui'ie  tn.ll  we  h.ivf'  k  no'ial  . 'igij  i  ,i '  •  ■  itr.  ,-'1  t  i  I'.e, 


III'  1  Miowii  va  r  I  am  e 


•  I j  1  )»  ■ :  K  I  ♦  (  '  ‘til  .1 

1 


When  the  variances  are  unknown  the  optima!  procoduve  in  i, '  is  [la  .nd 
on  t-tests  in  an  analoqous  way.  Let  s.  and  s^  denote  the  usual  MHV  unbi¬ 
ased  estimators  of  based  on  and  Y^,  respectively,  i-l,...,k.  Then 
nj^.Y^  at  Stage  I  has  to  be  replaced  by  n  ^s  ^  t  ( re  - 1  , 1  -  ) ,  and 

(t)  at  Stage  2  has  to  be  replaced  by  111^- s^,t(nY- 1  ,  , ) ,  where  t(n,  ) 

denotes  the  u-guantile  of  the  t-distribution  with  n  degrees  ui  treedi.)!:i. 

Though  a  (Bayesian)  decision  theoretic  approach  is  quite  difficult  tu 
perform  in  general,  the  case  of  k“  2  populations  can  at  least  be  studied, 
to  some  extent.  A  two-stage  procedure  will  now  be  described  by  S(X)(tiie 
random  subset  of  {1,2(  of  indices  of  those  populations  being  selected 
at  Stage  1)  and  d(X,Y)  (the  final  decision  at  ^tage  ,2).  As  before,  the  pro¬ 
cedure'  '.tops  and  decides  U,  i.c.  "none  is  better  tiiati  fl,,.'/  ii 
S(X)  ■  j'i  (  |li,(/t)  and  d(X,Y)  at  Staoe  i'.  used  only  if  S(X)  M,.'’-  . 

Let  ;  P  '  P  ,  with  •(O)  -  0,  tie  a  non-decreasi  ik!  function  whicli  acts 

as  loss-gain- function  with  respect  to  final  decision',  1  and  ■•'.  ■tssume 
that  decision  0  leads  neither  to  ,1  loss  nor  a  gain.  Moieover,  let  0 
b(>  ttie  costs  we  have  to  pay  if  w(>  wisn  10  peiforin  fiui'ie  2.  li'uilly,  let 
'  he  the  prior  distriliution  of  the  (now  I'arido  ;)  puru'::'"'  >■  .'ei.lor  .  die’, 
ffie  ovora  1 1  Bayesian  ri'>t  r.  liinn  by 

(^■1)  /  {u  •  'f  0-  i'''  :■  ■'  i--  ; 

t  i  i 

*  .  i  -  'll  ;  .  ■  '  ^  I 

1  lie  optimal  deer. ion  d*  a!  Stuu'-  .wn.'h  -  '  i  i/i",  i  hi  ,1  n. 

[leitcd  les'.  given  .tn.d  Y  ■  /  iKu",  nil  ii'ni'nl  ••n  Mm  .m'm-iI  .  tin  i  i 

any  '.ulisni  ■.nlni  tion  rule  S  and  tw>'n  uui  Vo  Im 


Ih 


(4.2)  =  i  iff  Ef.  'PIX--,  )r=r,| 

-■  minj;j,Ei;(-:^-.}.)|X=^,  Y  =  iji[,  '  i  ,j  ;  --  il,?|  , 

-ind  d*(f  ,n)  -  0  otherwise. 

The  optimal  subset  selr'ction  rule  S*  at  Stage  1  (which  i:iitiiini7('‘,  t  tu> 
posterior  expected  loss  given  X  -  ■  under  the  assumption  that  d*  will  he 
used  at  Stage  2)  decide-  according  to  the  smallest  o1  the  four  value-,  givf- 
in  the  following  scheme: 

(4.3)  S*(£j  =  0;  (1 

S*(;)  '  Mf;  r-(  i  l,?  . 

S*(f)  =  ;1,2,:  c  +  L-[uin|n,  min  f  -  •  (■  y-' -  - ) '  X- •,  ,Y  ( J  !  X  v;,  |  . 

ilotethat  in  tne  la  '.t  e'.pression  the  innei'  conditional  ^xpectiat  ion  i-, 
viewed  as  being  a  ^unction  ot  Y,  and  that  the  outer  one  is  the  expecta¬ 
tion  with  respect  to  the  (.onditional  distribution  of  Y-given  X 

Now  let  us  assume  tiie  Ygjiov/ido  normal  model:  i  ondi  t  iona  11  y ,  given 
0  =  a,  X  and  Y  ar'o  independent  witfi  X  T.  (  ■.(>1)  Jnd  Y  '■  (".(il),  and 
apriori  -  r,  ('Ql,nl),  p,q,r  •  0.  I  (,3^-  ]'  (M)- 

Then  by  using  for  convenience  U,  V, .  V.,,  which  are  assumed  to  be  in¬ 
dependent  standard  normals,  wc-  get  the  following  scheme  eguivalmit  i-i  (4. 

(4.4)  S*(:)  -  0  :  0 

S*(  ■  )  -  i':  f (1  '  pt  '  -  ,  )+ ("'-piptr)  ^)-d)),  i  !,■' 

\  •  IJ  1  ' 

S*(  )  !l.2,;  c+l  '  ‘I  min  ;(),min 

I  I  ,  -  ' 


where  ,  ^  hr[  (I'  +  r )  (rxi+pr+iir)  ]  •  and 


i  t'P<!/(pg*pt"^'|t  )  ]• 


r 


1  7 

Let  especially  v  be  linear,  i.e.  '.(a)  a.'.,  f  IK  ,  where  we  can  as¬ 

sume  without  loss  of  generality  that  a^  1  holds  (since  this  can  be  com¬ 
pensated  by  c).  Moreover,  let  us  for  a  moment  restrict  our  considerations 
to  two-stage  procedures  which  at  Stage  2  are  not  (lermitted  to  make  deci¬ 
sion  0.  (This  corresponds  to  procedures  in  a'  or  i  with  0.)  Tnen 

the  optimal  procedure,  denoted  by  d*  and  S*,  can  be  described  in  a  com  i'e 
form. 

(4.5)  d*(f,n)  =  i  iff  q;  .  +  pn  ■  <)/  .  ^  po-,  n  ,j  i  -1,;' 

~  1  1  j  J 

and  S*  decides  according  to  the  smallest  of  the  4  values  given  m  Hie  fol¬ 
lowing  scheme; 

(4.6)  S*(0  =0:0 

S*(f,)  =  lil:  ^(n^-.'..),  i-H  ,2, 

S*(s)  "  {1,2):  .':(o^-max)..-.|,.-.^;)+c-2~  .  t(  -  ^  ^  ;  )  , 

-1  ^ 

where  =  r(p+r)  and  T(y)  =  /  t  (x)dx,  y  f  IR  . 

The  last  expression  follows  from  Lemma  3  in  Micscke  (19/9b).  Lincc  i 
is  an  increasing  function  with  T(0)  {?•<)'-,  the  procedure  will  never  ai - 

rive  at  Stage  2  if  c  •  on'-.  But  on  the  other  hand,  let  c  ■  .  laHoi 

iin  n.  with  '  ■  .  j ,  li  ,j  H  {1 ,2  : ,  will  .Se  selected  by  S*.  Rut  now  ^  ',3 

or  then  S*(t)  “  ll,2i  if  and  onlv  if  ’  ^  •  T''((:'-  ,)'^  ). 

Moreover,  if  - ■  "p  there  is  an  area  in  the  neighborhond  of  ( 
where  also  S*(;;^,)  ^  {1,2  occurs.  Thus  within  is 

of  the  type  of  Gupta's  (1965)  maxim  im  means  proceuurf- . 


If  now  more  generally  a  decision  0  is  also  admitted  at  Staoe  tticn 
the  optimal  procedure  {S*,d*)  is  of  similar  form  tnit  is  no  longer  re|n e- 
sentable  in  such  a  cotKisi'  manner,  I /[i  i  (.,i  I  1  y  ,  fne  area  wherf'  at  Mane  1 


1.'-: 

both  populations  are  selected  will  be  larger. 

Finally,  let  us  mention  that  one  gets  analogous  results  it  otrier  loss 
functions  are  admitted.  It  is  thinkable  that  especially  ■(.)  ^  -!(■;) 
if  A  >  ,  .’-2  ■  lesds  to  a  procedure  which  is  closer  to  tti.it  one 

given  at  the  beginning  of  this  section.  But,  unfortunatel y ,  its  i cpresent.i 
tion  is  more  complicated  such  that  this  question  could  be  studied  only  num¬ 
erically. 
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1  =  1,. ..,k,  where  (  IR  is  a  fixed  given  constant.  The  goal  is  to  guarantn- 


at  least  a  probability  P*  of  makirnj  a  correct  decision  if 


,  i  =  I  , .  .  .  ,  k . 


and  to  inaxiiiiixe  the  probability  of  finding  a  population  better  than  other- 
wi  $e . 

Two-stage  procedures  of  tne  following  type  will  be  studied:  At  Stage  I, 
based  on  samples  all  populations  are  screened  out  which  appear  to  be 

no  better  than  If  none  (exactly  one)  is  left  the  procedure  stops  and  de¬ 

cides  that  none  (this  one)  is  better  than  ■■  .  If  more  than  one,  n.  with  i  cs, 

0  1 

survives  then  one  proceeds  to  Stage  ?.  Here  additional  samples  Y . ,  i  cs,  are 
drawn  and  final  decision  is  made  based  on  Y.  or  (X^,Y.),  i  C s. 

A  natural  class  of  two-stage  procedures  is  proposed  which  can  be  complete¬ 
ly  described  and  studied  in  terms  of  Neyman-Pearson  testing  theory,  where  tiie 
ur.-yiniietry  of  tests,  however,  can  be  overcome  to  a  considerable  extent.  As  a 
typical  result  it  is  shown  that  optimality  of  tests  carries  over  to  optimality 
of  two-stage  procedures,  finally,  under  normality,  comparisons  are  made  in 
case  of  k=  A  with  certain  Bayesian  procedures. 
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